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Feedforward  and  Feedback  in  Multiple  Cue  Probability 
Learning — Facilitating  or  Debilitating? 

Introduction 

Multiple  Cue  Probability  Learning  (MCPL)  research  has  typically 
<_  ployed  trial-by-trial  outcome  feedback;  the  basic  assumption  being  that 
subject  performance  will  improve  if  the  subject  is  provided  with  outcome 
feedback  during  the  learning  experiment.  Recent  evidence  questions  the 
validity  of  this  assumption.  For  example,  Hammond  and  Summers  (1972)  have 
noted  that  subject  performance  (specifically  Rs)  decreases  when  outcome  feed- 
back has  been  provided,  as  opposed  to  receiving  no  outcome  feedback  where 
no  decrease  was  noted.  They  suggested  that  in  learning  tasks  involving 
probabilistic  relationships  between  cues  and  criterion,  outcome  feedback 
contains  erroneous  information.  This  erroneous  information  results  in 
response  inconsistency  and,  therefore,  performance  is  affected  adversely. 
Hammond,  Summers,  and  Deane  (1973),  based  on  the  above  proposal,  hypothe- 
sized that  if  outcome  feedback  is  withheld,  then  subject  response  incon- 
sistency would  decrease  and,  in  turn,  performance  should  increase.  They 
tested  this  hypothesis  and  found  support  for  it  in  a research  experiment  in 
which  30  University  of  Colorado  undergraduates  served  as  subjects.  Results 
indicated  that  outcome  feedback  was  not  only  unnecessary  for  improving 
subject  performance,  but  was  detrimental  for  all  three  performance  indices: 
ra , Rg , and  rm.  Support  for  this  hypothesis  has  also  been  reported  by 
Castellan  (1974),  Holzworth  and  Doherty  (1974),  and  Swait.e  and  Castellan 
(1974),  who  found  that  subject  performance  was  adversely  affected  by 
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providing  subjects  with  feedback  information.  Some  of  the  feedback  provided 
was  outcome  feedback,  but  other  types  were  also  provided  (e.g.,  utilization 
coefficients) . 

More  recently,  there  has  been  some  interest  in  the  effects  due  to  what 
Bjorkman  (1972)  has  called  feedforward  information;  that  is,  information 
about  a task  which  is  given  to  subjects  prior  to  task  accomplishment.  For 
example;  Dudycha,  Dudycha,  and  Schmitt  (1973);  Newton  (1965);  Magnusson  and 
Nystedt  (1969);  and  Nystedt  and  Magnusson  (1973)  obtained  results  which 
indicated  that  subjects  were  able  to  improve  their  performance  by  feedfor- 
ward information,  such  as  ecological  validity  coefficients,  and  obtaining  the 
sign  of  correlative  relationships.  Holt  (1958),  however,  has  obtained 
results  which  indicated  that  subject  performance  did  not  increase  when  sub- 
jects were  given  ecological  cue-criterion  validities. 

The  present  investigation  focused  on  these  two  areas  of  interest  and 
involved  examining  the  effects  of  feedforward  and  feedback  information  on 
subject  performance  in  a psychologically  meaningful  setting.  This  study 
differs,  therefore,  in  that  these  two  factors  are  examined  within  the  same 
experimental  design — which  has  not  been  accomplished  by  previous  studies. 
Brunswik's  lens  model  (1952,  1956),  as  delineated  in  Dudycha  and  Naylor 
(1966) , and  Muchinsky  and  Dudycha  (1974) , served  as  the  theoretical  frame- 
work for  the  investigation.  The  lens  model  subject  performance  indices 
relevant  to  the  present  investigation  include:  (a)  subject  achievement 
(ra),  the  correlation  between  the  subject's  response  and  the  criterion 
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values;  (b)  subject  matching  (rm) , the  correlation  between  the  subject's 
predicted  responses  and  the  predicted  criterion  values;  (c)  subject  consis- 
tency (Rs) , the  correlation  between  the  subject's  responses  and  his  pre- 
dicted responses. 

The  major  questions  under  investigation  were:  (a)  Does  subjects'  per- 
formance differ  under  three  levels  of  feedforward  information?;  (b)  Does 
subjects'  performance  differ  under  five  levels  of  feedback  information?;  and 
(c)  Are  there  interaction  effects  between  feedforward  and  feedback  levels? 

In  attempting  to  answer  these  questions,  subjects'  performance  was  investi- 
gated over  blocks  of  trials  where  outcome  feedback  was  given  (i.e.,  blocks 
1-6)  and  over  the  terminal  performance  blocks  (i.e.,  blocks  7 and  8)  where 
no  feedback  was  given  (see  Table  1) . A condition  was  therefore  created 
where  a series  of  feedback  treatments  were  applied  (in  blocks  1-6)  and  the 
effect  on  performance  subsequently  measured  after  feedback  withdrawal  (i.e., 
blocks  7 and  8) . 

Method 

Experimental  Design 

The  experimental  design  and  the  levels  of  the  independent  variables  are 
presented  in  Table  1.  The  first  factor  is  the  feedforward  (FF)  factor  with 
three  levels.  As  indicated  earlier,  feedforward  information  is  any  informa- 
tion which  is  given  the  subjects  prior  to  the  administration  of  the  experi- 
mental trials,  as  opposed  to  feedback  information  which  is  given  subjects 


after  administration  of  one  or  more  trials. 
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The  first  level  (FFp  served  as  the  control  group  for  this  factor. 
Subjects  received  only  standard  instructions  in  which  they  were  told  they 
were  to  be  presented  with  two  test  scores  for  a total  of  200  college  gradu- 
ate school  applicants.  Their  task,  in  turn,  was  to  rate  each  applicant  on  a 
scale  of  10  to  90  on  his  probability  of  succeeding  in  graduate  school.  The 
second  level  (FF2)  consisted  of  providing  subjects  with  standard  instruc- 
tions plus  an  explanation  of  correlative  relationships.  Specifically,  they 

were  shown  scatter  plots  and  explanations  were  given  of  the  correlative 

. 

relationships  of  .00,  .50,  and  1.00.  The  third  level  (FF3)  consisted  of 
providing  subjects  with  the  same  instructions  as  for  FF2  plus  giving  sub- 
jects the  actual  ecological  validities  (i.e. , .80  and  .50). 

The  second  factor,  feedback  information  (FB) , consisted  of  5 levels, 
with  the  total  number  of  feedback  trials  held  constant  at  75  for  feedback 
conditions  2,  3,  and  4.  The  first  level,  FBj  (no  feedback  condition), 
served  as  the  control  group  for  the  feedback  factor.  For  this  condition, 
the  subjects  were  not  given  outcome  feedback  after  they  made  their  responses. 
The  second  level,  FB2  (random  feedback  condition),  consisted  of  providing 
subjects  with  a total  of  75  outcome  feedback  trials  randomly  presented  over 
the  first  150  trials.  The  third  level,  FB3  (massed  alternate  block  con- 
dition), consisted  of  providing  subjects  with  trial-by-trial  outcome  feed- 
back in  every  other  block  of  25  trials  (i.e.,  blocks  2,  4,  and  6),  with  a 
total  of  75  feedback  trials  presented.  The  fourth  level,  FB^  (massed  random 
condition),  consisted  of  providing  subjects  with  trial-by-trial  outcome 
block  1 (i.e.,  massed  feedback)  and  then  50  trials  of  random 
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outcome  feedback  during  blocks  2 through  6 (trials  26-150).  The  last  level, 
FB5  (trial-by-trial  outcome  feedback  condition) , consisted  of  providing  sub- 
jects with  the  traditional  trial-by-trial  outcome  feedback  during  blocks  1 

I 

through  6. 

The  third  factor,  blocks  of  trials,  consisted  of  a total  of  200  trials 
divided  into  8 blocks  of  25  trials  each  for  analysis  of  learning. 


Subjects 

Subjects  were  150  students  enrolled  in  the  introductory  psychology 
course  at  Purdue  University.  There  were  10  subjects  per  condition  for  all 
conditions  in  the  experiment.  Participation  in  psychological  experimentation 
was  a course  requirement;  however,  each  student  was  permitted  to  select  and 
participate  in  those  experiments  which  were  of  interest  to  him. 

Stimuli  Generation 

A total  of  200  stimulus  profiles  (i.e.,  cue-criterion  profiles)  were 

generated  in  8 blocks  of  25  trials  each  by  using  the  Ohio  State  Correlated 

Score  Generation  Method  (Wherry,  Naylor,  Wherry  and  Fallis,  1965).  Two  cues 

were  used;  the  first  labeled  "College  Entrance  Examination  Score  (CEES) ," 

and  the  second  labeled  "Dominance  Score  (DS)."  The  criterion  was  labeled 

"Faculty  Rating  (FR)."  Both  the  cues  and  the  criterion  had  means  of  50  and 

2 

standard  deviations  of  10.  System  predictability  was  Rg  = .89,  cue  1 and 
cue  2 were  orthogonal  with  validities  of  .80  and  .50  respectively.  The 
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sampling  error  for  the  empirical  validities  and  the  cue  intercorrelation  was 
within  ±.05  of  the  theoretical  values  for  each  block  of  25  trials. 
Presentation  Apparatus 

The  cues  and  criterion  data  were  displayed  on  a projection  screen,  using 
an  opaque  projector  fitted  with  a device  developed  especially  for  this  type 
of  experiment.  In  order  to  display  the  200  cue-criterion  profiles,  a series 
of  the  200  profiles  were  typed  on  a roll  of  teletype  paper.  Each  series 
represented  a particular  feedback  condition.  For  example,  the  FB^  (no  feed- 
back) condition  had  no  Faculty  Rating  criterion  feedback  values  typed  in, 
while  FB^  (trial-by-trial  outcome  feedback)  had  Faculty  Rating  criterion 
scores  for  each  profile.  By  using  a template  which  had  the  cue-criterion 
labels  typed  on  it,  the  cues  and  their  titles  could  be  presented  alone  on 
the  screen  or  with  the  Faculty  Rating  criterion  feedback.  The  device  per- 
mitted the  profiles  to  be  presented  sequentially  from  trial  1 through  trial 
200. 

Procedure 

For  each  of  the  15  experimental  groups,  instructions  and  response  sheets 
were  handed  out.  The  experimenter  read  the  instructions  aloud  to  each  group 
as  the  subjects  silently  read  along.  For  each  experimental  group,  the  sub- 
jects were  instructed  to  learn  the  strategy  which  was  appropriate  to  their 
condition. 

Each  experimental  session  began  with  three  practice  trials,  after  which 
any  questions  associated  with  the  experiment  were  answered.  During  the 
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experiment  proper,  for  a given  trial  the  subjects  were:  (a)  presented  with 
a display  of  the  two  cues,  (b)  given  time  to  make  their  predictions  on  a 
response  sheet  provided,  and  (c)  presented  the  cues  along  with  feedback  of 
the  actual  criterion  value  (i.e.,  Faculty  Rating  Score)  if  the  given  trial 
was  a feedback  trial  (see  Table  1 for  the  feedback  schedules) . The  next 
trial  was  then  presented,  each  trial  taking  approximately  15  seconds  to  com- 
plete. Each  session  lasted  approximately  one  hour  and  ten  minutes. 

Analysis 

The  subjects'  200  responses  were  divided  into  8 blocks  of  25  trials 
each  for  analysis.  Regression  equations  were  computed  which  represented  the 
subjects'  utilization  of  cues  over  blocks,  the  optimal  environmental  regres- 
sion equations  over  blocks,  the  predicted  subject  response,  and  the  predicted 
criterion  values.  Next,  the  dependent  subject  performance  indices  of:  (a) 
subject  achievement  (ra),  (b)  subject  consistency  (Rs) , and  (c)  subject 
matching  (rm)  were  computed  and  transformed  to  Fisher  Z values.  These 
values  were  then  used  as  the  input  data  for  analysis  based  on  the  design  in 
Table  1.  Three  ANOVAs  were  computed,  one  for  each  of  the  dependent 
variables — ra,  Rg,  and  rm»  All  factors  were  treated  as  fixed,  except  for 
subjects.  For  the  main  effects  found  to  be  significant,  simple  main  effects 
analyses  were  performed.  In  turn,  significant  simple  main  effects  were  then 
analyzed  by  the  Newman-Keuls  Sequential  Range  Test  in  order  to  identify 
specifically  which  means  in  a given  level  of  a factor  were  significantly 
different . 
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Results 

Subject  Achievement 

The  analysis  of  variance  summary  table  for  subject  achievement  (ra)  is 
provided  in  Table  2.  The  main  effects  for  blocks  of  trials  (B)  and  the  feed- 
back by  blocks  of  trials  (FB  x B)  interaction  were  found  to  be  significant. 
Simple  main  effects  analyses  were  performed  for  all  levels  of  these  two 
factors.  They  indicated  that  the  different  types  of  feedback  (FB)  were 
significantly  different  for  only  blocks  one  and  two,  while  the  blocks  effect 
was  significant  for  each  type  of  feedback. 


Examining  subject  achievement  across  blocks  of  trials  for  the  five 
feedback  conditions  revealed  that  subject  performance  was  highest  for  the 
two  feedback  conditions  (i.e.,  FB-^  and  FBj  conditions)  in  which  subjects 
received  no  feedback  during  block  1 (see  Figure  1).  In  block  2,  the  FB3 
condition  resulted  in  a significant  decrease  in  performance  (p  < .01)  when 
feedback  was  given  subjects,  while  the  FB^  (no  feedback)  condition  results 
indicated  a slight,  though  not  significant,  increase  in  performance.  The 
FB^  (massed  random)  condition  had  trial-by-trial  outcome  feedback  in  block 
1,  but  during  block  2 had  only  random  feedback  (i.e.,  feedback  information 
was  decreased).  The  performance  for  subjects  rapidly  increased  (p  < .01) 
for  the  FB^  (massed  random)  condition  during  block  2.  In  block  3,  subject 
performance  in  the  FB3  (massed  alternate  block)  and  FB5  (trial-by-trial 
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outcome  feedback)  conditions  significantly  increased.  During  blocks  6 and  7, 
there  was  an  apparent  increase  in  performance  (block  6)  and  then  a decrease 
(in  block  7).  This  variation,  however,  could  be  due  to  the  variation  in 
system  predictability  of  the  generated  profiles  which  directly  co-varied 
with  the  performance  indices,  as  did  the  control  group  over  blocks  6,  7, 
and  8.  Therefore,  it  is  suggested  that  this  apparent  effect  is  a statistical 
artifact. 


Subject  Consistency 

As  indicated  in  Table  2,  for  subject  consistency  (Rg) , the  main  effects 
for  feedback  (FB)  and  blocks  of  trials  (B)  were  significant,  as  were  the 
feedback  by  blocks  of  trials  (FB  x B) , and  feedforward  by  feedback  by  blocks 
of  trials  (FF  x FB  x B)  interactions. 

Tests  for  simple  main  effects  indicated  that  all  levels  of  both  feed- 
back and  blocks  of  trials  factors  were  significant.  Examining  subject  con- 
sistency across  blocks  of  trials  revealed  that  subject  consistency  was 
highest  for  the  feedback  conditions  in  which  subjects  received  no  feedback 
during  block  1 (i.e.,  FB3  and  FB^  conditions).  In  block  2,  the  FB3  (massed 
alternate  block)  condition  showed  a significant  (p  < .01)  decrease  in  sub- 
ject performance  when  feedback  was  given  to  the  subjects,  while  the  FB^  (no 
feedback)  condition  showed  a slight,  though  not  significant,  increase  in 
subject  performance.  For  blocks  2 through  8,  the  FBi  (no  feedback) 
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condition  was  significantly  (p  < .01)  higher  than  all  other  FB  conditions, 
except  in  block  5 where  there  was  no  significant  difference  between  the  FB^ 
(no  feedback)  and  FB3  (massed  alternate  block)  conditions. 

The  FB4  (massed  random)  condition  in  block  1 had  a trial-by-trial  out- 
come feedback;  however,  in  block  2,  this  feedback  was  reduced  (i.e.,  a 
random  feedback  schedule  was  started) . This  reduction  in  feedback  was 
accompanied  by  a significant  (p  < .01)  increase  in  subject  performance  in 
block  2. 

Focusing  on  terminal  performance  (blocks  6,  7,  and  8),  under  FF£  and 
FF3  conditions,  there  was  a distinct  and  significant  difference  between  the 
FB3  and  FB5  conditions.  Specifically,  subject  consistency  tended  to  remain 
at  a high  performance  level  under  FB^  and  to  decrease  under  the  FB5 
condition. 

Subject  Matching 

The  analysis  of  variance  summary  table  for  subject  matching  (rm)  in 
Table  2 reveals  that  main  effects  for  feedback  (FB) , and  blocks  of  trials 
(B)  were  significant,  as  was  the  feedback  by  blocks  of  trials  (FB  x B) 
interaction.  Once  again,  interest  was  focused  upon  the  significant  inter- 
action, and  simple  main  effects  analysis  performed  for  each  level  of  the  two 
factors  (i.e.,  FB  and  B) . The  test  for  simple  main  effects  indicated  that 
subject  matching  (rm)  was  significantly  different  under  different  FB  con- 
ditions at  blocks  1,  2,  6,  7,  and  8.  In  addition,  across  blocks  of  trials, 
the  FB3  (massed  alternate  block)  and  FB5  (trial-by-trial  outcome  feedback) 
factorial  levels  were  found  to  be  significant. 
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Examining  subject  matching  over  blocks  of  trials  revealed  a performance 
pattern  which  was  almost  the  reverse  in  block  1 of  that  found  for  r„  and  R • 
that  is,  the  no  feedback  conditions  (FB^  and  FB3)  had  the  lowest  performance 
values  during  block  1.  The  only  significant  difference,  however,  for  block 
1 was  between  the  FB^  (massed  random)  and  FBi  (no  feedback)  conditions 
(p  < .01),  where  FB4  (massed  random)  during  block  1 was  trial-by-trial  out- 
come feedback,  and  FB^  was  no  feedback  to  the  subjects.  In  block  2,  the 
matching  index  for  the  FB3  (massed  alternate  block)  condition  decreased 
when  feedback  was  provided  the  subjects  (decrease  was  not  significant). 

This  trend  was  the  same  as  obtained  for  the  ra  and  Rg  dependent  variables. 
Looking  across  blocks,  generally  the  FB^  (no  feedback)  condition  resulted  in 
poorer  performance,  although  not  always  significantly  so,  when  compared  to 
the  other  FB  conditions. 

In  addition,  for  FB3  (massed  alternate  block)  and  FB5  (trial-by-trial 
outcome  feedback)  treatment  groups,  there  was  a significant  (p  < .05) 
increase  in  subject  matching  performance  from  block  5 to  block  6 (last  FB 
block),  followed  by  a significant  decrease  in  block  7 (first  discontinued 
feedback  block).  This  increase,  followed  by  a decrease  in  subject  matching 
performance,  was  not  accompanied  by  the  same  significant  effect  for  the  con- 
trol condition  (FB ^ ) . It  appears  that  for  rm  this  effect  is  not  a statis- 
tical artifact,  as  was  suggested  to  be  the  case  for  ra. 

Results  Across  Dependent  Variables 


Blocks  of  trials  effect.  One  of  the  most  apparent  differences  between 
the  dependent  variables  ra,  Rg,  and  rm  was  noted  when  the  means  associated 
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with  the  blocks  of  trials  (B)  main  effect  were  examined.  There  was  a clear 
indication  that  subject  performance  is,  in  part,  a function  of  the  perform- 
ance index  used.  The  magnitude  of  subject  performance  was  greatest  for  sub- 
ject matching  (range  = .982-. 992),  followed  by  subject  consistency  (range  = 
.935-. 963),  and  lastly  subject  achievement  (range  = .846-. 902).  This 
relative  order  of  the  performance  indices  supports  previous  research 
employing  cues  with  positive  ecological  validities,  which  has  generally 
found  the  same  order  effect.  For  example,  this  order  effect  was  found  by 
Schmitt  (1972,  pp.  23,  33,  & 44)  for  abstract  cues,  and  by  Muchinsky  (1973, 
pp.  95-96)  for  meaningfully  labeled  and  positive  validity  cues.  Another 
aspect  worth  noting  is  that  all  three  dependent  variables  have  high  per- 
formance indices  from  blocks  1 through  8 (range  = .864-. 992)  in  this 
realistically  labeled  task. 

Feedback  information  effect.  Figure  2 provides  a plot  of  mean  values 
associated  with  the  feedback  main  effects.  It  reveals  that  subject  per- 
formance across  all  blocks  is  greatest  for  Rg  when  no  feedback  (FB^)  is 
given  subjects.  On  the  other  hand,  subject  performance  is  the  poorest  for 
rm  when  nxD  feedback  (i.e.,  FB^  treatment)  is  given  subjects.  This,  of 
course,  supports  the  previous  detailed  discussion  of  subject  consistency 
and  subject  matching  performance  indices.  In  addition,  if  one  considers 
that  rm  is  subject  optimal  performance  with  subject  inconsistency  removed, 
then  it  follows  that  rm  is  a more  important  index  of  subject  performance 
than  are  the  indices  ra  and  Rg.  If  this  line  of  reasoning  is  accepted, 
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Chen  it  can  be  said  that  outcome  feedback  generally  results  in  increasing 
subject  performance. 

« 

i 


Withdrawal  of  feedback  effect.  The  discussion  so  far  has  revealed  an 

/ 

apparent  decrease  in  subject  achievement  (ra)  when  feedback  was  discon- 
tinued, but  it  has  been  suggested  that  this  was  perhaps  a statistical  arti- 
fact. On  the  other  hand,  for  subject  matching  (rm) , the  same  phenomenon 
occurred  for  FB3  (massed  alternate  block)  and  FB5  (trial-by-trial  outcome 
feedback)  treatment  groups;  but,  for  that  case,  it  appeared  not  to  be  a 
statistical  artifact.  For  subject  consistency  (Rs) , there  was  no  such  sig- 
nificant phenomenon  for  any  of  the  feedback  groups.  Therefore,  upon  looking 
for  significant  difference  between  blocks  6 and  7,  and  blocks  7 and  8,  there 
appeared  to  be  tio  significant  increase  or  decrease  in  subject  performance 
after  feedback  was  withdrawn,  except  for  rm  under  FBg  (massed  alternate 
block)  and  FB5  (trial-by-trial  outcome  feedback)  conditions. 

Another  way  of  approaching  this  problem  is  to  see  if  subject  performance 
differed  between  block  6 (last  feedback  block)  and  block  8 (last  discon- 
tinued feedback  block).  This  approach  was  taken  by  examining  the  results 
obtained  from  the  Newman-Keuls  Sequential  Range  Test.  For  subject  achieve- 
ment, the  only  significant  difference  was  for  the  FB5  (trial-by-trial  out- 
come feedback)  treatment  condition  (p  < .01),  while  subject  consistency  had 
no  significant  differences.  On  the  other  hand,  subject  matching  had 
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Figure  Caption 


Feedback  Main  Effects  for  Subject  Performance. 
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significant  differences  between  blocks  6 and  8 for  FB3  (p  < .01)  and  FB^ 

(p  < .01)  conditions. 

Taking  the  two  approaches  into  account,  it  appears  that  subject  per- 
formance was  affected  very  little  for  the  different  feedback  treatment 
groups  when  withdrawal  of  feedback  occurred  after  150  feedback  trials. 
Degradation  of  subject  performance  was  limited  to  subject  matching  (rm) 
under  FB3  (massed  alternate  block)  and  FB5  (trial-by-trial  outcome  feedback) 
conditions,  and  to  a lesser  extent  for  subject  achievement  (ra)  under  the 
FB5  (trial-by-trial  outcome  feedback)  treatment  conditions. 

Discussion 


M 


The  purpose  of  this  study  was  to  investigate,  within  a psychologically 
relevant  setting,  the  effect  on  subject  performance  due  to:  (a)  different 
levels  of  feedforward  information,  and  (b)  different  levels  of  feedback 
information. 

Experimental  Setting 

The  data  indicate  that  subjects,  when  provided  with  a psychologically 
relevant  MCPL  setting,  can  perform  at  a very  high  level  of  proficiency. 

This  was  reflected  in  the  performance  indices  ra,  Rs,  and  rm,  which  ranged 
from  .864  to  .992  across  blocks.  This  finding  supports  Miller's  (1973) 
research  where  he  found  that  subjects'  performance  was  worse  in  a mis- 
labeled or  no-labeled  setting  than  in  a setting  with  cues  properly  labeled. 
It  also  supports  Muchinsky  (1973)  who  investigated  the  effect  of  a sup- 
pressor variable  on  subject  performance  in  a meaningfully  labeled  and 
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abstractly  labeled  setting.  Subject  performance  was  found  to  be  superior 
in  a realistic  setting  with  meaningfully  labeled  cues. 

Feedforward  Information 

The  lack  of  a significant  main  effect  for  feedforward  information 
indicates  that,  generally,  statistically  naive  subjects  are  unable  to  use 
this  type  of  information  adequately  to  improve  their  performance  in  an  MCPL 
task.  The  one  exception  was  for  subject  consistency  (Rs)  where  a signi- 
ficant FF  x FB  x B interaction  was  obtained.  For  this  case,  feedforward 
information  appeared  to  be  affecting  only  terminal  performance  (blocks  7 
and  8).  When  subjects  were  provided  with  only  a set  of  standard  instruc- 
tions (feedforward  1),  terminal  performance  resulted  in  no  significant 
differences  between  types  of  feedback  information  given.  However,  when 
subjects  were  given  either  an  explanation  of  correlative  relationships 
(feedforward  2)  or  an  explanation  of  correlative  relationships  plus  the 
actual  ecological  validity  relationships  (feedforward  3) , there  resulted 
an  increase  in  subject  consistency  for  the  n£  feedback  condition  (FB^) 
and  a decrease  in  subject  consistency  for  the  trial-by-trial  outcome  feed- 
back condition  (FB^) . Therefore,  the  data  indicate  that  feedforward  infor- 
mation affects  subject  consistency  during  terminal  performance  in  a 200- 
trial  MCPL  task.  For  the  FB^  (no  feedback)  condition,  performance  drops 
off  when  only  standard  instructions  are  given,  but  increases  when  FF2  or 
FF3  information  is  given.  On  the  other  hand,  trial-by-trial  feedback 
(FB5)  results  in  decreased  subject  consistency  when  FF2  or  FF3  information 
is  given. 

The  above  finding  that  statistically  naive  subjects  generally  are  not 
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able  to  use  feedforward  information  adequately  to  improve  performance  sup- 
ports Holt's  (1958)  study  which  indicated  that  subject  performance  did  not 
increase  when  given  the  ecological  cue-criterion  validities.  On  the  other 
hand,  Newton  (1965),  Magnusson  and  Nystedt  (1969),  and  Nystedt  and  Magnusson 
(1973)  obtained  data  which  indicated  that  subjects  who  were  given  ecological 
validity  coefficients  could  use  this  information  to  improve  their  perform- 
ance (ra  index).  Dudycha,  Dudycha,  and  Schmitt  (1973)  found  that  subjects 
given  an  explanation  of  positive,  zero,  and  negative  correlative  relation- 
ships performed  better  than  subjects  without  this  type  of  information,  but 
performed  even  better  when  given  the  actual  ecological  validity  relation- 
ships— all  of  which  were  negative  correlations. 

First,  Newton's  (1965)  study  is  highly  suspect  since  the  results 
associated  with  feedforward  and  feedback  effects  are  confounded.  On  the 
other  hand,  the  studies  of  Magnusson  and  Nystedt  (1969) ; Nystedt  and 
Magnusson  (1973);  and  Dudycha,  Dudycha,  and  Schmitt  (1973)  obtained  clear 
evidence  that  subject  performance  increased  when  feedforward  information 
was  given.  There  is  one  area  which  is  common  to  these  studies;  namely, 
that  the  subjects  were  statistically  sophisticated  (i.e. , had  some  pre- 
experimental  knowledge  of  statistical  relationships) . In  the  present 
study,  the  subjects  were  naive;  that  is,  the  subjects  had  no  pre-experi- 
mental  knowledge  of  correlative  relationships.  Therefore,  subject  statis- 
tical sophistication  might  account  for  the  differences  between  these 


studies. 
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This  is  an  area  that  requires  further  study.  The  area  should  be 
further  investigated  using  statistically  (not  just  mathematically)  sophis- 
ticated subjects  and  statistically  naive  subjects  in  order  to  ascertain  if 
statistical  sophistication  is  a moderator  variable  in  MCPL  tasks. 

Feedback  Information 

The  data  obtained  from  this  study  indicate  that  whether  feedback  infor- 
mation increases  or  decreases  subject  performance  depends  upon  the  perform- 
ance index  used.  Generally,  subject  performance  increases  if  feedback  is 
given  when  the  performance  index  used  is  subject  matching  (rm) . On  the 
other  hand,  performance  decreases  with  feedback  when  the  indices  of  subject 
consistency  (Rs)  and  subject  achievement  (ra)  are  used. 

Initial  performance.  In  addition  to  this  overall  trend,  there  is  an 
effect  due  to  feedback  during  the  early  stages  of  an  MCPL  task  (blocks  1 and 
2)  which  generally  parallels  the  trend  described  above.  For  subject 
achievement  (ra)  and  subject  consistency  (Rg) , performance  was  the  highest 
when  no  feedback  was  presented.  If  feedback  was  reduced  after  receiving 
feedback  for  25  trials,  performance  increased;  while  if  feedback  was  given 
after  no  feedback  in  block  1,  performance  decreased.  On  the  other  hand, 
for  subject  matching  (rm) , performance  was  the  poorest  when  no  feedback  was 
given. 

Terminal  performance.  During  terminal  performance  (blocks  7 and  8) , 


there  appeared  to  be  an  effect  when  using  the  performance  indices  rm  and  Rg, 
but  not  for  ra.  The  terminal  performance  effect  associated  with  subject 
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consistency  (Rs)  was  discussed  previously  relative  to  the  FF  x FB  x B inter- 
action. For  subject  matching  (rm)  performance,  there  was  a significant 
increase  for  groups  receiving  FB3  (massed  alternate  block)  and  FB5  (trial- 
by-trial  outcome  feedback)  information  during  the  last  feedback  block  (block 
6)  and  a significant  decrease  when  feedback  was  discontinued  in  block  7. 

These  two  experimental  groups  received  trial-by-trial  outcome  feedback 
during  block  6. 

The  data  suggest  that  for  the  performance  index  rra,  subjects  receiving 
trial-by-trial  outcome  feedback  performed  as  though  they  were  sensitive  to 
the  experimental  instructions,  which  indicated  that  block  6 was  the  last 
feedback  block.  The  subjects  increased  their  performance  during  block  6 
to  the  highest  magnitude  obtained  during  the  experiment,  then  decreased 
their  performance  when  feedback  was  permanently  discontinued  in  block  7. 

This  is  another  area  in  need  of  further  research.  Do  subjects 
receiving  trial-by-trial  outcome  feedback  rely  heavily  upon  it,  and — knowing 
that  it  is  to  be  permanently  withdrawn — decrease  their  subject  matching  per- 
formance upon  feedback  withdrawal? 

Feedback  literature.  There  has  been  little  research  associated  with 
the  effect  of  different  schedules  of  feedback  on  subject  performance  in  MCPL 
tasks.  Somewhat  related  to  this  area,  however,  are  the  studies  of  Castellan 
(1974);  Hammond  and  Summers  (1972);  Hammond,  Summers,  and  Deane  (1973); 

Holzworth  and  Doherty  (1974);  and  Swaine  and  Castellan  (1974).  Taken 
together,  the  above  studies  indicate  that  outcome  feedback  may  be 
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detrimental  to  learning  complex  probabilistic  relationships  such  as  those 
associated  with  MCPL  tasks.  This  result  is  in  general  support  of  the 
findings  of  this  research  study  for  the  performance  indices  ra  and  Rg>  but 
not  for  rm.  The  detrimental  effect  was  most  clear  for  Rg,  where  there  was 
a marked  differential  between  the  no  outcome  feedback  condition  and  the 
remaining  four  feedback  conditions.  In  addition,  the  most  detrimental 
effect  associated  with  the  present  research  study  was  found  during  initial 
performance  (blocks  1 & 2).  Obviously,  since  so  little  research  has  been 
performed  in  this  area,  final  opinion  should  be  reserved  until  more  evi- 
dence is  available.  Nevertheless,  it  appears  at  present  that  outcome  feed- 
back degrades  performance  for  the  indices  ra  and  Rg,  with  the  greatest 
effect  being  during  initial  performance  in  blocks  1 and  2. 

Conclusion.  The  data  suggest:  (a)  that  subjects  provided  with  a 
psychologically  relevant  MCPL  setting  with  labeled  cues  can  perform  at  a 
very  high  level  of  proficiency  without  feedforward  or  feedback  information, 
(b)  that  statistically  naive  subjects  are  unable  to  use  feedforward  infor- 
mation to  improve  their  performance,  (c)  that  whether  subject  performance 
increases  or  decreases  when  provided  with  feedback  information  depends  upon 
the  performance  index  used  (i.e.,  ra  and  Rg  decrease,  while  rm  increases), 
and  (d)  that  withdrawal  of  feedback  generally  has  little  effect  upon  sub- 
ject performance. 
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